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Abstract 

In this article we discuss several aspects of the stochastic dynamics of spin models. The 
paper has two independent parts. Firstly, we explore a few properties of the multi-point 
correlations and responses of generic systems evolving in equilibrium with a thermal bath. 
We propose a fluctuation principle that allows us to derive fluctuation-dissipation relations 
for many-time correlations and linear responses. We also speculate on how these features will 
be modified in systems evolving slowly out of equilibrium, as finite-dimensional or dilute spin- 
glasses. Secondly, we present a formalism that allows one to derive a series of approximated 
equations that determine the dynamics of disordered spin models on random (hyper) graphs. 

1 Introduction 

There are several motivations to revisit the stochastic dynamics of spin models with and with- 
out disorder. Starting from a random initial condition, at low enough temperature, these models 
usually have a very slow evolution with several aspects in common with the one of real glassy sys- 
tems. For instance, during coarsening the global auto-correlation functions of ferromagnetic Ising 
models on finite dimensional lattices [1] age in a rather similar way to the one observed in molec- 
ular dynamic simulations of Lennard- Jones mixtures [2] , a typical glass former. The asymptotic 
linear response [3] to an external perturbation of these non-frustrated and non-disordered models 
is, however, different from the one measured in glasses. The non-trivial slow response observed 
numerically [2] and experimentally [4] is captured by modified spin models in which frustration 
and/or disorder are added [5]. A standard example is the fully-connected disordered p spin model 
in which all p-uplets of spins interact via random exchanges. The statics [6] and Langevin dynam- 
ics [7] of this mean-field model have been solved analytically in great detail and there is growing 
consensus in that this and related models yield a mean-field description of the structural glass 
transition and glassy dynamics. 

More recently, the interest in studying similar disordered spin models on random graphs and 
random hyper-graphs (as opposed to the complete graph or hyper-graph) has grown. The reasons 
for this are multiple. 

From the glassy point of view, the dilute disorder models "approach" the finite dimensional 
actual problem one would like to understand while still being mean-field. Due to the dilute nature of 
the interactions not all fluctuations are suppressed in the thermodynamic limit. In more technical 
terms, when the number of spins in the system diverges, the disordered average dynamics is not 
completely described by the two-time global auto-correlation and linear response but all kinds of 
many-time functions carry non-trivial information about the dynamic behavior of these systems. 
Since this will also happen in finite dimensional problems one might expect that the knowledge on 
the behavior of these higher-order correlations in the dilute problem be of help. 

Dilute disordered spin models are highly non-trivial even in their paramagnetic high-temperature 
phase. As shown by Bray [8] these models have a Griffiths phase "generated" by the fluctuations 
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in the connectivities of the vertices of the random (hyper) graph. A complete solution to the dy- 
namics of one such model might help imderstanding the nature and properties of Griffiths phases. 
In particular, the existence or not of a Griffiths phase in quantum disordered finite-dimensional 
systems in contact with a quantum environment has been the subject of intense debate recently [9] . 
The analytic solution of a quantum model even if defined on a random graph might be of help in 
this discussion. 

Dilute disordered spin models yield also a representation of several problems of great interest in 

computer science [10]. For instance, the dilute p spin disordered ferromagnetic model represents the 
so-called xOR-sat problem [11] and variations on the p spin disordered spin-glass model describe the 
fc-sat optimization problem [12, 13]. These models are usually attacked with numerical algorithms 
that do not correspond to a physical dynamics like the Glauber or Langevin ones [14]. Having said 
this, it would be interesting and useful, also for these computational problems, to understand their 
evolution under physical dynamics. 

Finally, in several problems of physical interest, as the gelation process, dilute random matrices 
play an important role [15]. The methods and results here discussed will be relevant for these 
problems too. 

This paper presents two independent results for the Langevin dynamics of spin systems. In the 
first part we derive several general relations between many-point correlations and linear responses 
that any system in equilibrium with a thermal bath must respect. These equations are derived 
using a general fluctuation principle. We then discuss how these relations might be modified in a 
system evolving slowly out of equilibrium as we know the above mentioned models do when the 
temperature of the environment is sufficiently low. In the second part of the paper we introduce a 
functional method to attack the Langevin dynamics of spin models defined on random graphs. We 
discuss how one recovers the well-known Schwinger-Dyson dynamic equations for the disordered 
averaged two-time correlations and linear responses in the fully-connected limit. We next explain a 
set of iterations that allow us to deal with the disordered averaged dynamics of the dilute problems 
in an approximated way. This part extends results briefly presented in [16]. 

We wish to stress here that since we expect self-averageness when an infinite system evolves out 
of equilibrium, a model with a typical realization of disorder should behave in the same way as the 
averaged result predicts. Still, we also know that the infinite size model will keep local fluctuations 
due to the sample-dependent fluctuations in the site connectivities and the random exchanges that 
will be lost when performing the disorder average. 

The paper is organized as follows. In Section 2 we discuss the properties of many-time corre- 
lations in and out of equilibrium. We then argue on which are the modifications of these relations 
(applied to global functions) that are expected in a system that slowly evolves out of equilibrium. 
In Section 3 we give a precise definition of the models we are interested in and we introduce the 
functional method. Finally, we present our conclusions and directions for future work. 



2 Many-point functions 



A way to characterize the dynamics of a generic model is to determine the evolution of the many- 
point correlators and linear responses defined as 
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(2) 

(3) 



h=0 



etc. The angular brackets denote an average over different realizations of the dynamics. For 
a Langevin process as the one in Eq. (6) this simply indicates an average over thermal noise 
realizations. The response in Eq. (2) corresponds to a case in which the magnetic field hii^{tk) 
couples linearly and instantaneously to the ife-th spin modifying the Hamiltonian at time tk in 
such a way that H ^ H — hi^{tk)si^. Equation (3) defines the response of the observable made 
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of a product of fc — 2 spins to kicks applied linearly to two spins ik-i and ik at the instants tk-i 
and tk, respectively. One can easily generalize this definition to any number of kicks. Note that 
we do not assume any special ordering of times and that the kicked and responsive spins can be 
the same. 

When studying models with quenched disorder, as the ones introduced in Section 3, one is 
usually interested in their disorder-averaged behavior. Hence one further averages these expressions 
over the probability distribution of disorder and indicates this calculation by embracing the right- 
hand-sides with square brackets. Since under the disorder average cross-terms involving different 
spins typically vanish, one usually focuses on the "global" correlations and responses. In particular, 
the two-time ones are defined as 



2.1 Properties in equilibrium 

In equilibrium the time-dependence of multi-point correlations and responses is constrained in 
several ways. These constraints are a consequence of the fact that the probability distribution 
of any configuration C of a thermostated system in equilibrium is given by the time-independent 
Gibbs-Boltzmann distribution P{C) oc exp(— /iJiJ), with /? the inverse temperature and H the 
Hamiltonian, and that causality is expected to hold. (We set the Boltzmann constant A;b to one 
henceforth.) Moreover, model-independent relations between correlations and responses can be 
established and are the expression of the so-called fluctuation-dissipation theorem (fdt) . 

These equilibrium properties have been worked out in detail for two-time functions and they are 
easy to derive using a variety of methods. In particular, for a Langevin process with white-noise 
one can exploit its connection to a Fokker-Planck equation, or one can use the super-symmetric 
version of the dynamic generating function using the symmetries of the action to constrain the 
properties of the observables (see, e.g., [5] for a review). With both techniques one finds the 
following properties of two-time functions: 

i. Time-translation invariance (tti), C(zi, fi, i2, i2) = C{ii,i2',ti — t2), for any two sites and any 
two-times. 

a. Causality, -R(ii, ti; J2, ^2) = if ^2 > ti. 

in. Fluctuation-dissipation theorem, /3i?(zi, <i; 12, ^2) = dt2C{ii,ti,i2,t2), for ti > t2. 

iv. Reciprocity or Onsager relations, {A{t)B{t')) = {A{t')B{t)), for any pair of observables A and 

B which are functions of the spins. 

For fully-connected models in the thermodynamic limit one can easily prove that all many- 
point correlations decouple into products of two-time ones (if there is an applied magnetic field, 
a one-time quantity, the average spin also enters in the decomposition). Hence, these quantities 
have been the focus of most of the analytic (but also numeric and experimental) studies of glassy 
systems. 

Here, we establish generic properties that multi-point correlations and responses must satisfy 
in equilibrium. We shall later discuss how these may be generalized for systems slowly evolving out 
of equilibrium. In order to prove these generic properties we use the Fokker-Planck representation 
of the Langevin equation. As special cases we recover the properties i-iv of two-time functions. 

We focus on a stochastic dynamics of Langevin type in which each dynamic variable, sj , evolves 
with 




(4) 



i=l 





(6) 



{t) is a Gaussian thermal noise with zero mean and white-noise statistics: 



i^jimkit')) =2Td,kS{t-t') 



(7) 
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with T the temperature of the thermal bath in contact with the system. We have rescaled time 

in such a way that the friction coefficient is set to one. The time-dependent distribution function 
P{C,t) = P{s,t) evolves according to the Fokkcr-Planck equation: 



3 ■' 



(8) 



In equilibrium this equation is solved by the Gibbs-Boltzmann distribution Peq(s) = Z~^e~l^^^'^\ 
with Z the partition function. A very useful representation of this equation takes advantage of its 
similarity with the Schrodinger equation and associates the functions of the stochastic variables 
with states in quantum mechanics [17] 

- I/) , {9\f) = j dsg{s)*m , (9) 

and defines position and momentum operators 

d 

Sjf{s) ^ Sj\f) , -i—f{s) ^ pj\f) , [sj,Pk] = iSjk ■ (10) 



dsj 



Note that sj = sj and pj = pj . Using this notation the Fokker Planck equation reads 



d 



P{t)) = H,,\Pit)} , \Pit)} = e^-*|P(0)) , H,, = Y,P3 {^H^0) - Tpj) , 



dt' 

where Hj = SH/Ssj. One also defines a projection state: 

(-1/) = / dsfis) (11) 

and writes the equilibrium state as |Pcq) — ^^^e^'^^'^"^ |— ). The matrix elements of cxp{Hj,pt) are 
transition probabilities. Hence the correlation functions of the observables Ai that are functions 
of the variables Si are expressed as 

{AM...A,{h)) = (-|i„e^-(*"-*"-)i„_i...iie^-*HP(0)) , (12) 

with tn > tn-1 > . . . > > 0. is obtained from A^ by replacing the variables with the 
corresponding operators. The linear response to a field coupled linearly to the spin corresponds to 
adding —ihjPj to Hyp- Thus S/Shj{t) ^ —ipj in the sense that the effect of the applied field 
is represented by the insertion of —ipj at time t in a correlator. 
Two useful properties also expected are time reversal symmetry 

e^^'^'^Hppe-^"'^'^ = H+ , (13) 

that is due to detailed balance, and causality, that implies {—\pi = 0, so that the response of any 
correlator to a field applied after the observation times vanishes. 

Let us now describe in detail the extensions of the properties i-iv to multi-time functions. 



2.1.1 Time translation invariance 

The time-translational invariance of equilibrium correlation functions is transparent in this formal- 
ism. Consider Eq. (12) where all times are shifted by the same amount At: 

{Anitn + At) . ..Ai{ti + At)) = (-|i„e«-(*''-*'-^)i„_i . . .iie^-(*^+^*)|P(0)) , (14) 

If the system is equilibrated at time t = 0, |P(0)) = |Peq) and by definition Hpp\Peq) = so 
that exp(i?FpAt)|Peq) = l-feq)- Hencc the time-translational invariance of equilibrium correlation 
functions: 

{A„itn + At)...Ai{ti+At)) = {An{tn)...Ai{ti)) . (15) 

Clearly, for a two-time function one recovers property i. 
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2.1.2 Generalized Onsager relations 

These express the time reversal symmetry of equilibrium correlation functions. Consider t„ > 
tn-i > . . . > ti =0 and, for simplicity, let us use the spins themselves as the observables. Then, 

{sM-..SjM) = (-|%„e^'^'*"-*''-^^%„-i---Si.e^-*=s,-JPeq) (16) 
= (P,q|s^.^e^^t*.5.^..j._^e^i(*"-*"-)s,„|-). (17) 

Using (Peql = (— I exp(— /3_ff), |— ) = exp{(3H)\Pcq) and the relation (13), one obtains: 

(Si„(tn)Sj„-i(in-l) • • • Sj2(i2)Sji(0)) = 

{Sjlitn)Sj.,itn - t2) ■ ..Sj^_^{U - t„_l)Sj„(0)) . (18) 

The usual Onsager relation on two-point functions is a particular case and reads: (s^ (i)s/c(0)) = 
(sfe(t)sj(O)). For a three-time correlator one has {si{—t2)sk{t\)sj{t2))={sj{—t2)sk{—t\)si{t2)), for 
t2 > \ti\- lil = i, with the two extreme times fixed, the correlation is an even function of ti. 

Similar relations can be derived for generic functions of the spins as long as they do not include, 
when expressed in the quantum mechanical language, the operator p. In the two-time case these 
reduce to property iv. 

2.1.3 FD relation on two-time functions 

According to the previous definitions, the usual equilibrium linear response function reads: 



= (-|s,e^-*(-ipfc)|Peq) , (19) 



where we simplify again the presentation by considering the response of the simple observable given 
by a spin to a perturbation done on another spin. Generalizations to more complicated observables 
are straightforward. 

On the other hand, the equilibrium correlation function and its time derivative are 

Cjk{t) = (s,(t)sfc(0)) = (-|s,e^-*Sfc|Peq) , (20) 
jCjk{t) = (-|%e^-*ifppSfe|Peq) . (21) 

By definition of the equilibrium probability distribution, [Tipk + -fffc(J))|Peq) = Vfc. Using this 
relation and the commutation properties of the operators, one obtains 

H^MPeq) = Tipk\Peq) (22) 

and thus recovers the usual FD relation in equilibrium: 

Rjk{t) = -^f^Cjk{t), t>0 (23) 

2.1.4 FD relation on 3 point functions 

Response to a single kick 

The first type of three point response function one has to investigate is the response of a two 
point correlator to a single kick. It is clear by causality that the response vanishes if the kick is 
posterior to the observation times. Two cases must then be distinguished: 

• The perturbation is done prior to the two observation times. Let us choose t2 > ti > to, 

^ {Sk{ti)si{t2)) = {-\sie"-^'^-'^^Ske''-^'^-'°\-tpj)\P,q) . (24) 



Shj{to) 
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The three time correlator and its derivative with respect to the earlier time are: 



Using (22), one obtains: 
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Shjito) ^*'^(*i)^'(*2)) = ^^(s,(to)sfc(ti)s/(i2)) . (27) 

This relation is a natural generalization of the usual fdt. 

• The perturbation time is in between the two observation times. For the sake of clarity let us 
denote the three times t2 > ti > —t2- By time translational invariance, we do not loose any 
generality with this choice. Then, 

^ {s,{-t2)si{t2)) = (-|s^e^-(*=-*^)(-^p,)e^-(*^+*^)s,■|Peq) • (28) 



Shk{ti) 

Considering the time-reversed (conjugated) expression, with j and / exchanged and ti re- 
versed, and using the Baker-Campbell-Hausdorff formula e~^^ Pke^^ = Pk — i^Hk, this can 
be rewritten as 

^ {si{-t2)sj{t2)) = {-\he"-^'^-''\ipk + l3Hk)e"^^'^'^+'^^Sj\P,^) (29) 



Shk{-ti) 

Consider now the derivative with respects to the intermediate time of the three time corre- 
lator: 

^{s,{^t2)sk{h).si{t2)) = (-|J,e^-(*^-*^)[sfc,i7pp]e«-(*i+*=)s,|Peq) . (30) 

oil 

Since [sk, Hj,p] = —2iTpk — Hk, we have the following model independent FD relation: 
\ d S 

j;-Qf^{Sj{-t2)Sk{tl)si{t2)) = ^^^^^^^ (gj(-^2)g;(^2)) 

6 



Note that while on the left-hand-side we have the "expected" variation of the three-time correlator, 
on the right-hand-side two responses appear (and none vanishes due to causality). 

Response to two kicks 

One can also construct the response of an observable to two earlier kicks. Taking t2 > ti > to, 

^'^''^^^^^ = {-\ke"-^'^-''\-ipk)e"-^''-''^\-ipj)\Pe,) , (32) 



6hj{to)5hk{ti) 
and using Eq. (22) one obtains 

S^{siit2)) 1 d f 6 



■{sj{to)si{t2)) 



6hj{to)Shk{ti) Tdto \Shkiti) 

Interestingly enough, we find that the three point correlator does not determine completely the 
three point responses. 
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2.2 A general fluctuation principle 

In the previous Section we derived some fd relations on a case-by-case basis. One may wonder 

whether these relations can be expressed in a unified way. 

For the sake of simplicity, let us consider the case of a single time- varying field h{t), coupled 
linearly to any given observable 0{s) (here we denote by s the whole spin configuration: s = 
{si . . . Sat}). In order to state a unifying principle for the multi-time FD relations, we need some 
quantity which encodes the full hierarchy of correlation and response functions defined above. Let 
us denote by x_^^^^ j.^^ a particular trajectory of the observable x between the times —Im and Im- 
Hereafter wc shall assume Im to be larger than any other time in the problem and we shall drop 
the subscripts. Consider the probability density dP{s\li} of a trajectory s of the system, given a 
particular realization h of the external field. It is clear that, by integrating dP{s\K) over s and 
expanding in powers of h, wc can recover all the correlation and response functions. 

In order to state a fluctuation principle for -P(s|/i), we need to define the time reversal operation. 
The time reversed of x is denoted by x^ and is defined by x^{t) = x{—t). We make the following 
assumptions: (i) the probability distribution at the initial time —Im is the equilibrium one in 
zero- field: Peq(s); (H) the dynamics satisfies detailed balance; (Hi) the perturbing field vanishes 
outside the time interval [—tM,tM]- Under these hypotheses, it is easy to show that 



dP{s\h) 



= exp I -/3 j " dt h{t) 0(t) I , (34) 



where 0{t) denotes the time derivative of the observable 0{s) along the trajectory s. 

The proof of Eq. (34) is straightforward^ if we assume Ito discretization of the Langevin 
dynamics (6). In this case the probability density of a trajectory s can be written explicitly 

dP(s|/l)=Peq(s(-tM))^n'^(?'W-^iW-^ + '^(^)^)^ -ds, (35) 

where Peq{s) is the equilibrium distribution. Using this expression one obtains 

^{t)} , (36) 



dPjsV) PMtM)) ^ 

dPm - Peq(«(-iM)) 1 ^^J-^f 



5H JO 



which reduces to (34) upon the insertion of the Boltzmann distribution Peq(s) oc exp(— /3il(s)). 
It can be useful to formulate a few simple remarks on this result: 

• In the h = case, Eq. (34) is simply a rephrasing of time-reversal invariance. A time- varying 
external field violates this invariance. The amount of such a violation is quantified by the 
work done by the field on the system. 

• Equation (34) can be regarded as the dynamic analogous of the following identity 



dPeq{s\h) 



exp{-2/3/iO(s)} , (37) 



which holds if dPeq{s\—h) is the probability of the configuration s according to the Boltzmann 
distribution. 

• Using Eq. (34) we can recover the FD relations of the previous Section. As a simple exercise, 
let us consider the relation between two-point functions (23). We take 0{s) = Sk, multiply 
both sides of Eq. (34) by Sj{ti)dP{s\h) and integrate over s. This yields 



(s,(-ti))^« = {sjih) ■ exp|-/3 j dt' hk{t')sk{t')^)h, 



(38) 



^Nevertheless the result (34) holds under more general hypotheses, for instance in a discrete-time Markov chain. 
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where {■)h denotes the average under applied magnetic field h. Expanding the two members 
of this identity in powers of h, we get, at the linear order: 

^gf^isAtMt,)) - -JJ^ - -^j^-^ , (39) 

which, using causality yields back Eq. (23). 

The general strategy for deriving FD relations for multi-time functions is easily stated: (i) 
multiply both sides of Eq. (34) by the quantity Sj^ (ti) ■ ■ ■ s,^ (tm) • dP{§.\ll) ! (**) integrate over 
s; (Hi) expand in powers of h and collect the terms multiplying h{tm+i) ■ ■ ■ h{tm+n)- This 
procedure yields a relation for (m + n)-times functions. Of course if we want to study the 
response to kicks on several distinct spins we must consider the obvious generalization of Eq. 
(34) to the case of several observables. 

• Equation (34) can be used to derive relations which arc exact with a non- vanishing perturbing 
field. A simple example is Eq. (38). With an appropriate choice of the time dependence of 
hk{t), this result is amenable for a numerical check. Unlike for the usual fd theorem (23), 
one is not obliged to take the zero-field limit which can be numerically tricky. 

• Finally, the principle (34) is quite reminiscent of the Gallavotti-Cohcn (gc) theorem [18, 19] 
as stated in Ref. [20] (see also [21, 22]) for stochastic dynamics. However GC refers to 
stationary systems and has a non-trivial content only if the dynamics violates the detailed 
balance. In Eq. (34) wc consider the complementary situation. Detailed balance is satisfied 
at any time, but time-reversal invariance is violated by the explicit time-dependence of the 
external field. Hopefully this type of result is more suitable for the present context. 

2.3 Extensions out of equilibrium 

The non-equilibrium slow dynamics of glassy systems presents rather simple modifications of the 
equilibrium properties of two-time correlations and responses [7, 23, 5]. The two-time global 
correlations decay (increase) monotonically as a function of the longer (shorter) time. This property 
allows one to propose "triangular relations" that link, in the limit of long times, any two-time 
correlation to other two evaluated at an intermediate time: [23] 

C{h,ts) = f{C{h,t2),C{h,t3)) h>t2>h. (40) 

Using very general arguments one then proves that within a correlation scale (see [23] for its precise 
definition) the global two-time correlator behaves as 

C{h, *2) = ^ E ii'iiiMt2))]j = f (41) 

with l{t) a monotonic growing function. Moreover, in the limit of long times one finds that the 
FDT is modified to 



N ^ 6hi{t2) 

1=1 ^ ' 



= (42) 

1 EFF Cl2 

/(=0 



with Teff a correlation-scale dependent effective temperature [24]. In this Section we discuss 
possible generalizations of these properties to the case of multi-time functions. 

2.3.1 Time-scalings 

Let us first discuss the consequences of having multiple correlation scales, as defined via the 
behavior of the two-time global correlator, on the multi-time global ones. The latter are defined 
from Eqs. (4): 

C{ti,t2,...,tn) = — ^C{i,ti,i,t2, . . . ,i,tn) , (43) 
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and are the ones expected to be relevant in a disorder average treatment. 

For concrctcncss, take a system with two correlation scales (as happens for the fully connected 
p spin model and, presumably, for the dilute case too). This means that in the asymptotic limit 
in which t\ > t2 are both long but their ratio ti/t2 vary between one and infinity the times are 
classified according to the value of C(ti,i2)- If ti and t2 are near by and C(ti,f2) > Qea, we are 
in the fast correlation scale. If ti and t2 are far away, C{t\,t2) < Qea, and we are in the slow 
correlation scale. 

Taking three times > t2 > is we have four possibilities: 

i. The three times are nearby with all correlations being larger than Qea- 

ii. The longer times ti and t2 are nearby while the shortest one is far away; in this case, 

C(ti,t2) > Qea > C{ti,U) and C{tiA2) > (?ea > C{t2,t3)- 

Hi. The "reversed" situation in which the two shorter times t2 and ts are nearby and the longest 
one h is far away; then C{ti,t2) < Qea < C{t2,h) and C{ti,ti) < Qea < C{t2,t3). 
iv. Finally the three times can be far away from each other in which case all correlations are 
smaller than ^ea- 

The property of monotonicity can be used to express any muti-point correlator in terms of 

two-time ones. Take for instance a correlator evaluated on three times, C{ti,t2,t3). Using the 
monotonicity property one can invert the two-time correlation C12 = C(ti,t2) and write ti = 
g{Ci2,t2)- Equivalently, t2 = S'(C23,i3)- Thus, 

Cih,t2,h) = C{giCi2,g{C23,t3)),g{C23,h),h) . (44) 

If we assume that the limit ti > t2 > ts ^ 00 while C12 and C23 are kept fixed exists then 

C{h,t2,t3) = f['\Ci2,C23) . (45) 

Clearly, we could have chosen to work with ti = S'(Ci3,t3) and obtain 

C{tut2,t3) = /f^(Ci3,C23). (46) 

The liberty to choose representation is clear in the equilibrium case where one can write 

Cih,t2, t3) = f^Zih -t2,t2- t3) = f^l]2ih - h, t2 " ^s) = /iq.U^l " ^3, h - ^2) • 

With similar arguments one can write any multi-time correlation in terms of two-time correlations 
only admitting that the limits exist. In all cases we choose to take the limit of the shortest time 
to infinity to ensure that all two-time correlations are in their asymptotic regime. 

As an example consider a case in which there are two correlation scales and that the three times 
are chosen in such a way that two of them, ti and ^2, are nearby so that the two-time correlation 
C{ti,t2) falls above ^ea and the third one is far away from both in such a way that the two-time 
correlations C{ti,t3) and C{t2,t3) fall below q^A- Then we expect 

C{tr,t2,t3) = f{t^-t2,^-^^ . 

This relation (and similar ones) generalize time-translational invariance for multi-time correlations 
[see Eq. (15)] to the slowly evolving non-equilibrium case. 

2.3.2 Fluctuation — dissipation relations 

Another important feature of glassy dynamics is the modification of the fiuctuation - dissipation 
theorem. The corresponding out-of-equilibrum fiuctuation-dissipation relation (ofdr) for two- 
point functions has been the object of intensive studies in the last years (see [5] for a review). 
In Section 2.1.4 we obtained fluctuation dissipation relations for multi-time correlations and 
responses. Here, we discuss the possible form of the corresponding multi-time OFDr's. 

Guessing the correct generalization of the multi-time FD relations is quite diSicult. Already in 
equilibrium, the form of these relations is far from obvious and a careful derivation was necessary. 
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Here we shall adopt the following approach. We consider the multi-point correlation and response 

functions of a Gaussian model. In this case the two-time OFDR, straightforwardly implies multi-time 
OFDR's. We then rewrite these relations in a model-independent fashion. This can be done in a 
particular compact way by modifying the fluctuation principle of Sec. 2.2. 

For the sake of simplicity, we shall consider the case of a scalar field (j){t) with t > 0, linearly 
coupled to an external field h{t). Being Gaussian, its behavior is completely specified by the 
following quantities: 

M{t) = {m, C{t,t') = mW)) , R(t;t') = ^-^. (47) 

As a warm-up exercise, let us consider three point functions. It is simple to show that, in the 

Gaussian case: 

C{h,t2,h) = M{h)M{t2)M{t3)+M{h)C{t2,t3)+M{t2)C{h,t3) + 

+M{t3)C{ti,t2), (48) 
R{t2,t3;h) = M{t2)R{t2;ti) + M{t2)R{t3-M), (49) 
R{t3;t2,ti) = 0, (50) 

where we chose the ordering of times ti < 1,2 < ts, which we shall keep in this Section. We should 
now make some assumptions on the long time behavior of the functions in Eq. (47). To keep the 
presentation as simple as possible we shall consider a scenario with two correlation scales: 

M{t) « Meq, (51) 

C{t,t/) « C,^{t-t') + C,^{l{t)/l{t')), (52) 

R{t;t') « R^q{t-t') + l{t')R^^{l{t)/l{t')). (53) 

with 

/3a,Ceq(r) = -i?eq(T) , /3k.p dt'C,^{l{t)/l{t')) = l{t')RMt)IKt')) ■ (54) 

We defined l{t) = l'{t)/l{t) that we assume to vanish when t ^ oo. All the times in our discussion 
below are such that the above asymptotic forms are well verified. 

Let us consider the different cases for the response to a single kick (we leave the two-kick case 
as an exercise for the reader): 

• The perturbation is done at time t\, i.e. prior to the two observation times. We must 
distinguish several different possibilities according to the scaling of the time separations 

(^2 - ti) and (is - ^2), as ti,t2, h 00: 

- {t2 - ti) and {t3 - 12) of 0(1). We get 

dt,C{tiM,h) ~ -M,qdC,^{t3-h)-M,qdC,^{t2-ti), (55) 

R{t2,t3;tl) « Meqi?cq(t3-il)+Afcqi?cq(t2-<l), (56) 

where we noted by dC{ ) the derivative of C(-) with respect to its argument. From 
Eqs. (55) and (56) we recover the FD relation for three time functions: 

l3dt,C{ti,t2,t3) « R{t2,t3;h). (57) 

— {t2 — ti) = 0(1), (ts — 12) — > 00. In this case we have 

dt,C{h,t2,t3) « -Meq%^^5Cag(/(t3)//(tl))-Meq5Ceq(t2-tl), (58) 
R{t2,t3;h) « Meqf(ii)i?ag(i(t3)/«(tl)) + Meqi?eq(i2-il). (59) 

At first sight it may seem that Eqs. (58) and (59) are much more difficult to deal with 
than Eqs. (55) and (56). Notice however than the first terms in the above expressions 
are of order l{ti) with respect to the second ones, and can therefore be dropped in the 
aging limit. In this limit the FD relation (57) is once again saisfied. 
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— {t2 - ti) oo, {ts - t2) = 0(1). We have 

dt,C{ti,t2,h) ~ M,^dt,C,s{l{t3)/l{ti)) + M,^dt,C^g{l{h)/l{h)), (60) 
R{t2,t3;ti) « M,J{h)R,g{l{t3)/l{ti)) + M,J{h)R,g{l{h)/l{ti)). (61) 

Using Eq. (54), it is easy to show that these functions satisfy the natural out-of- 
equiUbrium generaHzation of Eq. (57): 

/3EFF9tiC(ii,t2,t3) « R(t2M;ti). (62) 

— {t2 — ti) OO, (f3 — 12) 00. This case is similar to the previous one. The relation 

(62) is recovered. 

• The perturbation time is t2, i.e. in between the two observation times. This case is more 
interesting than the previous one. As before, we need to treat separately the different time- 
scalings: 

— (^2 — h), {ts — 12) = 0(1). This case is quite simple: 

dt,C{h,t2,t3) « -MeqaCeq(t3-i2)+MeqaC'eq(t2-tl), (63) 
R{tuH\t2) « Meqiieq(t3 - i2) , (64) 
R{ti,4;t^) « Meqiieq(i2-tl), (65) 

where we defined the time-reversal operation as follows 

t^t^ = t* -t (66) 

for some (large) fixed time t*. Using Eq. (54) we re-obtain the equilibrium relation, c/r.. 
Eq. (31) 

pdt, C{ti , t2, h) « Rih,t3; t2) - Rit^, tf- 1^) . (67) 

— {t2 - h) = 0(1), {ts - t2) 00. We have 

dt,C{tlM,h) « -Meq^%^^aC'ag(/(t3)//(i2))+Meq9Ceq(t2-tl), (68) 

R{tuts-M) « M,J{t2)R^siKt3)/l{t2)), (69) 
R(t^,t^:t^) « Meqi?eq(t2 - ii) . (70) 

Notice that the first contribution to the correlation, c/r. Eq. (68), and the response 
(69) are of order l{t2) with respect to the other terms, and therefore vanish in the aging 
limit. One recovers therefore the equilibrium relation (67). 

— (f2 — ti) CO, (t3 — t2) = 0{1). This case works exactly as the previous one: the 
equilibrium FD relation (67) holds up to terms of relative order l{ti). 

— {t2 — ti), {ts — t2) ^ 00. Here something interesting finally happens: 

dt,C(tut2,t3) « M,^dt,C\g{l{ts)/l{t2))+M,^dt,C,^{l{t2)/l{tl)), (71) 
R{txM-M) ~ Meqf(f2)i?ag(Ki3)//(t2)), (72) 

R{t^\tf-tf) « M,J{t,)R,,{l{t2)/l{ti)), (73) 



where we defined the "aging" time-reversal transformation as follows: 

!(r) 

m 



t^ffl' = ri(^), (74) 
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for some (large) fixed time t*. Using this expression and the relations (54) one can easily 
show that 



l3^F^dt,C{tut2,t3) « R{ti,h;t2) - R{tf,tf;t^') . (75) 

In other words, the out-of-equilibrium FD relation is obtained from the equilibrium one 
by replacing the thermodynamic temperature with an effective one, and by a redefinition 

of the time-reversal operation. 

At this point it is easy to summarize the above results (and the similar ones which can be 
derived for higher correlations) along the lines of Sec 2.2. More precisely, let us split the field in 
its fast components plus the slowly varying part [25, 26]: 

Ht) = Cl)eci{t) + (t)^g{t) , h{t) = heqit) + /lag(i) • (76) 

While 4>eci{t) obeys a fluctuation principle of the form (34), this has to be modified as follows for 
?!'ag(i): 



exp |-/3eff j dt Kg{t) (^ag(i)| • (77) 



Here /i^' and 6^^ are defined analogously to h/^ and i/)^ (c/r. Eq. (34)) but using the time-reversal 
operation (74) instead of the usual one. The reader can easily check Eq. (77) on a Gaussian process. 
It is natural to conjecture it to hold even for non-Gaussian ones. It would be of great interest to 
check this conjecture in a numerical simulation. 

Let us by the way notice that Eq. (77) implies a whole class of out-of-equilibrium Onsager 
relations. A simple example is 

Cag(tl,i2,i3) =Cag(il,t^,<3) if l{t2)l{t'2) = litiWi) . (78) 



3 Dilute disordered spin systems 

Dilute disorder spin models are typical cases where a description in terms of two-point functions 
only is not complete. Multi-point correlations do not factorize and carry non-trivial information 
about the dynamics of these systems. 

In this Section we introduce a method to solve the disorder averaged dynamics of these models 
with a succession of approximate steps. The approach follows closely the one used by Biroli and 
Monasson [27] for the analysis of the spectrum of random matrices. In short, we first define the 
models of interest, we next explain the functional method used and we finally give a hint on how 
the equations derived can be solved in some simple cases. 

3.1 The models 

A family of disordered spin models is defined by the Hamiltonian 

Hj = ^ ' •^ii...ipSjj Sjj . . . Sjp . (79) 

ii<...<ip 

The spins Si, i = 1,...,N, can be Ising variables, ,s,- = ±1, Vi (Ising model), or they can be 
real variables. In the latter case one can cither constrain them such that 5^,^]^ = N (spherical 
model), or add a "soft-spin" term to the Hamiltonian which favors the values of Si around ±1. 
The parameter p is a fixed integer, p > 2, which controls the number of spins involved in each 
interaction term. 

The couplings between the spins are given by the quenched random variables Ji^..^^- In the 
fully-connected case, all the (^) entries in these "tensors" are non-zero and, equivalently, the 
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model is defined on the complete (hyper) graph. Generally, one uses a Gaussian (or bimodal) 

probability distribution with zero mean and variance [J^_^ j^],/ = plJ^ /{2NP~^) in order to ensure 
a good thermodynamic limit. (Henceforth, the square brackets denote an average over quenched 
disorder.) 

In the dilute case, there is only an extensive (proportional to N) number of non-zero interaction 
terms in the sum (79). The interactions are drawn from 

P{Jn...i,) = (l - ^) + ^n(J,,..,J , (80) 

in which 11 (J) does not contain a Dirac distribution at J = 0. The (finite) parameter a is the 
average ratio of the number of interacting p-uplet of spins per variable. When p = 2 this is the 
Viana-Bray model [29, 30]. Its geometrical structure is the one of the celebrated Erdos-Renyi 
random graph [31]: the model consists of spins occupying the vertices of a graph drawn from this 
ensemble, with interactions on the edges. For p> 3 the model is defined on a random hypergraph, 
the edges are replaced by plaquettes linking p vertices. For any p, the probability distribution of 
the degree of a given spin, i.e. the number of interactions it belongs to, is a Poisson law with mean 
ap. 

As there is an extensive number of non-zero terms in (79) in the dilute case, each of them must 
be of order 1 to obtain a sensible thermodynamic limit. The distribution 11 of the non-vanishing 
couplings must thus have finite mean and variance. For concreteness we choose 

n(Jn...iJ = I [S{jn...i, -J) + 6{Ji,...i^ + J)] , (81) 

with J finite. Note that the fully-connected limit is recovered from the dilute case by taking 

a = NP~^/pl and ,P = plJ^ /{2Np~^), or more generally a ^ oo, J ^ with Jq = 2a,P finite. 

The soft-spin Ising (a) or spherical (b) constraint are imposed via an additional term in the 
Hamiltonian: 

N N 

^/ = E«(^'-1)' («)' Vs = n{t)J2('j~^) (82) 

The (time-independent) parameter k should be taken to infinity to recover the Ising limit and the 
(time-dependent) Lagrange multiplier /x(f) is to be determined self-consistently by imposing that 
the equal-time correlator be normalised to one. In what follows we call H the full Hamiltonian, 
given by the sum of Hj and the appropriate constraint, V = Vi or V = Vs, 

H = Hj + V, V = Y,<Sj). (83) 

j 

Our aim is to study the Langevin dynamics of such a model, defined by equations (6) and (7), 
which mimics the physical situation of a system in contact with a thermostat at fixed temperature. 



3.2 Summciry of results 

Several special cases of model (79)-(6) have been studied in the past. A vast majority of these stud- 
ies has been confined to the (technically simpler) case of fully-connected models. For a summary 
of results see [5] . 

There has been however a recent growing interest in dilute systems [29, 30, 32, 33], for at least 
two reasons. On the one hand, even if they arc still mean-field, with no notion of geometry, their 
finite connectivity is an ingredient for the description of real physical systems that was absent from 
the fully-connected models. Moreover, the fluctuation of their local connectivity leads to Griffiths 
phases [8] which arc experimentally observed in some physical systems. On the other hand, a large 
number of optimization problems, satisfiability for instance, can be mapped onto dilute models 
of Ising spins [12, 11]. This observation triggered a large effort towards the understanding of the 
static properties of such models, which lead to very interesting recent results [13]. At the moment 
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the understanding of their dynamic behavior is much poorer. One could however hope that it 
would be very useful for the study and the improvement of local search algorithms that solve these 
optimization problems [14]. 

Previous studies of physical dynamics of dilute p spin models include: 
(i) Montecarlo dynamic simulations were performed for Ising spins and two-body [34, 35] or three- 
body [36] interactions. These numerical studies pointed out the heterogeneous character of the 
non-equilibrium dynamics for fixed quenched disorder. Moreover Refs. [36, 35] demonstrated the 
validity of out-of-equilibrium fluctuation-dissipation relations for single-spin two-time functions. 
The single-spin OFDr's turned out to agree with the results of a static calculation. (See [37] for 
local FD relations between coarse-grained two-time quantities in finite dimensional glassy systems.) 
(m) An analytic solution to the disordered averaged dynamics of the spherical p = 2 dilute model 
can be achieved by solving the Langevin equation in the rotated basis in which the interaction ma- 
trix is diagonal [16]. This study showed the existence of two non-equilibrium dynamic asymptotic 
regimes. The first one is very similar to the one of the fully-connected counterpart model [38]. 
The second one is dominated by the tails in the spectrum of the random interaction matrix and 
corresponds to progressive condensation on the eigenvectors that are localized on these sites. 

Let us state as a side remark here that the spherical dilute model with p > 3 is pathological. 
Indeed the spherical constraint J2j ^"j — ^ can be satisfied in at least two opposite ways. Either 
all the spins are of order 1, that is the situation one would like to obtain, or a finite number of 
them are of order \/iV, a strongly localized situation. Imagine that the p spins interacting through 
a given plaquette are all localized. As the coupling on a plaquette is of order 1 in the dilute case, 
this would contribute with a term of order N^/'^ to the energy, this situation would thus dominate 
the thermodynamic limit of such models when p > 3. Note however that such a pathology can be 
cured by adding infinitesimal terms of the soft-spin type, £^j{s'j — 1)", with n sufficiently high, 
to the Hamiltonian. 

3.3 Functional formalism 

In this Section we introduce a generic formalism to derive macroscopic dynamic equations for the 
evolution of global correlation and response functions. 

Standard techniques allow us to derive a dynamic generating functional, 2, for a generic 
Langevin process with white noise, as a path integral [39] : 

2[r],ri] = J VsiVisiVi:p^l}i exp(-S'EFF + ^ dt' [vi{t')si{t') - fii{t')isi{t')]) 



'SkvF — I dt 
rt 



TiiSiit')f+iSi{t'){dtSi{t')+ 



Ssi{t'), 



where we have introduced two time-dependent sources rji{t) and •qi{t). Einstein's summation con- 
vention is assumed. The fields Si and si are real, si being a response field conjugated to .s;, whereas 
and ■^j are Grassman fermionic fields. The correlation and response functions of the stochastic 
process solution of the Langevin equation (6), averaged over the different realizations of the noise 
(7), are given by derivatives of Z: 

C{ii,ti,...,ik,tk) = -z 7-^; J 7-^, (85) 

5r]i,{ti)...dr]i^{tk) 

R(i\,t\, . . . ,ik-i,tk-i;ik,tk) = t — tti j tt -.c- x ■, (86) 

Hi (ti) . . . {tk-i)t>T]i^^ (tk) 



R{ii,ti, . . . , «fe-2. tk-2'-h--i'tk-i-ik- tk) 

s'-z 



6r]i, {ti)... 6r]i^_^ {tk-2)Sfji^_^ {tk-i)6f}i^ {tk) ' 



(87) 



14 



the sources being set to zero after calculating the derivatives. In other words, the correlation and 

response functions arc averages taken with the normalized weight exp(— 5eff)- The response fields 
—iSi(t) are inserted at the times where a magnetic field hi has perturbed the system. 

Z can be written in a very compact form if one introduces the super-field formulation of 
stochastic processes as explained in [40]. In this approach one first enlarges (spacc)-time to include 
two Grassmann coordinates 9 and 9, i.e. t ^ a = {t,9,9). The dynamic variables Si{t) and 
the auxiliary variable isi{t) together with the fermionic ones tpi{t) and Vi(i) are encoded in a 
super-field, 

$i(a) = Si{t)+9^i{t) +^i{t)9 + is^{t)99 . (88) 

With these definitions, 

Z[C] = J P$exp Q j da $i(a)L>i2)$.(a) - j da H[${a)] + j da Ma)Ci{a] 



with da = dtd9d9, $ = ($i, 
defined as 



(89) 

, $Af), Ci(a) = rii{t)99 + 'f)i{t), and the dynamic operator d'^^ is 



d_ 
di 



(90) 



dode ' dedt 

If the model is spherically constrained, one can absorb the constraint in the quadratic part of 
the action by redefining 

i)i2)-Z)f +M,(a) (91) 

with /Lt«(a) a super Lagrange multiplier, with the form (88). If one deals, instead, with the soft 
spin model, the non-quadratic term Vi[^] appears in H. 

The super-symmetric notation allows one to encode in the single super correlator 



Oi,(a,6) = ($,(a)<i>,(6)) 



(92) 



the two-time correlators and responses, Cij{t,t') and Rij{t,t'). Indeed, the super-correlator (a, 6) 
has 16 "components" . However, many of these vanish or are related to each other due to the sym- 
metries that should hold in a physical situation [40] as ghost number conservation and causality. 
Imposing these properties one is left with a simpler expression for Qij that encodes the physical 
self-correlation and the linear response: 



Q^jia,b) = aj{ta,tb) + {9b - 9a) {9bR^J{ta,tb) " 9aRJ^{tb,ta)) 



(93) 



Note the terms in which two fermions appear equal the response functions. The equilibrium 
properties can also be expressed as super-symmetries and constrain further the two-point super- 
correlator imposing TTI and fdt. 

Similarly, all the three point functions defined in Section 2 are contained in Qijk{a,b,c) = 

($,(a)$,(6)<&fe(c)). 

We are interested in correlations and responses averaged over the disorder. The fact that Z is 
equal to 1 in the absence of sources, independently of the realization of the disorder [41], implies 
that these averaged functions are generated by [Z]j. Since the generating functional itself (and not 
its logarithm) has to be averaged, one can avoid the use of replicas. The only term that depends 
on disorder in the action in Z is Hj. The average over the probability distribution of the couplings 
(80) and (81) reads 



= e 



g-/ daHjlS(a)] 

= n 1 + (^°^^ (-^ / («)••• (a)) - 1 



: exp 



H (cosh^J j da^i,{a)...<^>. 



(a) - 1 



(94) 
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at leading order in N. 

The next step to take is to disentangle this effective Hamiltonian and to reduce the full problem 
to a single-spin one, that will be evaluated using saddle-point methods. An advantage of the SUSY 
notation is that it parallels the static replica calculations [42]. The manipulation of the dynamic 
effective Hamiltonian is done following the same steps as in the replica static calculation. For this 
one takes advantage of the empiric correspondence between super-coordinates and replica indices. 

For fully-connected models, the reduction to a single spin problem can be done by introducing a 
global two point function Q{a, 6), or the global Parisi matrix Qab in replica terms. For dilute models 
the procedure is much more difficult. One possibility is to introduce the whole set of multi-point 
super-correlators Q{a,b), Q{a,b,c), etc. This route was followed in the original treatment of the 
statics of the Viana-Bray model [29]. We follow here a different strategy that was introduced by 
Monasson [33] (see also [32]) in the replica static context. It is based upon the introduction of a 
functional order parameter. 

Let us define c(^') as the fraction of sites with super-field identical to a chosen value ^ 



1 ^ 

i=l 



(95) 



where the functional 6 enforces that ^{a) = $i(a) for all values of the super-coordinate a. Note 
that c is normalised, /l?^c(^') = 1. 

As emphasized in [33] , the mean-field character of the models implies that their effective Hamil- 
tonian, after performing the average over disorder, can be expressed in terms of such a global 
functional order parameter. For the dilute p spin models under consideration here, one obtains 



-heff[c] = " y" 



cosh [ J da \E'i(a) . . . <E>p(a) 



(96) 



We enforce the definition of c{'^) in the generating functional by introducing an identity in its 
path integral representation: 



-I 
-I- 



VcDic exp 



/ ic(4')(iVc(*) - ^ (5 [* - $i]) 

i=l 

- N ■ 

i V^Nic{-^)c{^) -^ic{^i) 

. i=l 



VcVic exp 

After doing so we achieved our goal of disentangling the N degrees of freedom 

[Z]j = j VcDic exp[-iVG] 

G = - Jv^ zc(*)c(*) + ifEFF - In Jv^e^I 



with 



dav('S'{a))-ic{'S') 



(97) 



(98) 



(99) 



We can now evaluate Z with the saddle-point method. Enforcing that G is stationary with 
respect to c and c yields: 



c^^(*) = 
c'^{^) = 



X exp 

SHeff [c 



\J da *(a)£)^2)^(^) ~ J - i^^i^) 



(5c(*) 

with A a normalization constant. 



(100) 
(101) 
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Let us give the interpretation of such equations. The correlation functions computed with the 
normalized weight c^''(^') are the averages of the original single-site functions: 

f c^^(f ) v|/(ai) . . . vl/(afe) = ^J2 ■ • • Mak))]j • (102) 

•' i 

To enlighten the physical meaning of Eqs. (100) and (101), let us consider the fully connected limit, 
with a oo, J ^ and Jg = 2a finite. Expanding the hyperbolic cosine in (96), only the first 
term of the series survives: 

^^EFF Jv^i...V^p 0(^-1) . . . c(*p) J dadb *i(a)*i(6) . . . *p(a)*p(6) (103) 

The relation between and c^^ thus becomes: 

c'^<S>) = ^ J dadb Q'^{a,b)<P-^'^^{a)<S>{b) , Q'^{a,b) = j T^"^ c^''(*) *(«)*(&) (104) 

and • represents the direct or Hadamard product (see the Appendix A). We thus obtain the 

SUSY form of the well-known single spin equation for fully connected models: averages of are 
taken with a Gaussian weight (apart from the soft-spin v term) , to be determined self-consistently 
through Q^^. It is the equation of a single degree of freedom evolving through a Langevin equation 
with a retarded interaction and a colored noise, which are to be expressed self-consistently in terms 
of the correlation and the response of the process [43] . 

In the dilute case, one can also follow this idea, but the self consistency equations cannot 
be written solely in terms of the two point function. The whole hierarchy of many-coordinate 
correlations appears: 



c^^(*) = A exp 



\j da *(a)£)(2)*(a) - j da v{^{a)) 



°° j2n r 

""^X](2n)! J '^'^l---'^"2n *(ai)...*(a2„) (52n(ai, • • • , 02n)*^^"^^ 



(105) 

Q2n{ai, a2n) = I c^^(*) *(ai) . . . *(a2n) (106) 



This equation cannot be solved exactly. A set of approximation schemes can be envisaged. In 
the following we critically discuss some of the approximations one can use. 



3.4 Approximation scheme 

In this Subsection we discuss some approximations to the saddle-point equations (105) and (106) 
that is exact in the thermodynamic limit and determines the behavior of all global correlators. 



3.4.1 Cutting the series 

The simplest approximation one can envisage is to simply cut the series appearing in the right- 
hand-side of (105) after the first term in such a way that only Q{a,b) enters the approximated 
equation. This is equivalent to proposing that c is quadratic. It is easy to see that with this 
approximation we recover the fully-connected counterpart model, with Jq = J\/2a. The solution 
does not go beyond the results already known for this case [7, 23, 38]. 

Presumably, better approximations are obtained by progressively keeping some higher order 
correlations. More precisely, one could cut the series after the second term and then derive (exactly 
in the spherical case or with a further approximation to treat the effect of the soft-spin term v) 
a set of dynamic equations coupling Q(a,b) and Q{a,b,c,d) only. One could also cut the series 
after the third term and then derive a set of dynamic equations coupling Q{a, b), Q{a, b, c, d) and 
Q{a, b, c, d, e, /) and so on and so forth. 
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This is the kind of approach used when deriving and cutting BBGKY hierarchies in field- 
theoretical models or condcnscd-mattcr problems. It is also similar to the procedure used by 
Viana and Bray [29] in their study of the statics of the dilute ± spin-glass model with two-body 
interactions close to its transition temperature where the Q's (in replica space) can be assumed to 
be small. 

3.4.2 An iterative procedure 

A different procedure consists in evaluating c(^') (and the super correlators) iteratively. The idea 
is: 

(i) In the first step one uses the simplest Ansatz for c(\l/) and evaluates Heff- (We discuss two 
ways of implementing this initial step). 

{ii) Next, one uses Eq. (100) [after replacing c with (101)] to obtain an improved expression for 
c^^(*). 

(iii) With this form one calculates Heff again and goes to (ii). 

This procedure follows very closely the proposal of Biroli and Monasson to compute the density 
of states of sparse random matrices [27] . The SUSY formulation of the dynamic generating functional 
makes the treatment of the dynamic problem very similar to the static calculation that uses the 
replica trick (see [42] for a recent discussion of the relation between SUSY and replica analysis). 

An additional feature to be considered in this iteration is how we update the constraint on the 
normalization of the correlation, i.e. the fact that Q{a,a) = 1. For the spherical model we shall 
demand this constraint to be valid at each step of the iteration. This means that we shall modify 
the Lagrange multiplier in such a way to impose the constraint. 

Importantly enough, after the first iteration one accesses the functional order parameter c{'^) 
and hence all many-point correlations simultaneously though approximately. One can expect that 
even after using only one step of the iteration this method will yield better information than simply 
cutting the series keeping only a finite number of terms. This is indeed the case when studying 
the spectral properties of random matrices. 

3.4.3 First step: the effective medium approximation 

In the first step we use the simplest approximation that captures the same behavior as the "effective 
medium approximation" [27, 28]. In this approximation, one treats the environment of each point 
on the random graph in a uniform manner. In the calculation of the spectral density of sparse 
random matrices this approximation yields a symmetric distribution with a finite support that 
qualitatively resembles a semi-circle. Thus, the result is a simple modification with respect to the 
usual Gaussian case. This approximation fails to capture the effect of highly connected sites that 
clearly deviate from the effective medium assumption. These imply the appearance of tails in the 
density of states that are not obtained at this level of the calculation. 

The dynamic effective medium approximation can be done in at least two ways: 

Cutting the series 

Going back to what we discussed above, one can use as the starting c{^) the result of cutting 
the series in (105) after the first term, deriving and solving a self-consistent equation for Q{a,b) 
and using this as an input to compute c(^'). 

Gaussian approximation 

A slightly different (but qualitatively equivalent) starting point is given by proposing a Gaussian 
Ansatz for c(^'): 

Cema(*) = {det Q)-^/^ exp (^-^ J dadb^{a)Q-\a,b)^{b)j . (107) 
One can easily check that the denominator ensures the normalization of c(\E') and that Q{a, b) is 
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correctly given by 

Q{a,b) = j V^^{a)^{h) exp (^-i j da'db' 'i>{a')Q-\a' ,b')^{b') 

This form is closer to the approximation used in [27, 28] . 

To advance further it is convenient to express the c-dcpendent effective action in terms of 
Q{a,b). This can be done exactly for the spherical problem. When we deal with the soft spin 
case, instead, the non-quadratic term Vi{^) has to be treated within an additional approximation. 
We shall discuss this point later. For the moment we focus on the spherical models. After rather 
simple manipulations one finds 

[Z]j = j VQ e-^-'W) , with 
2S§^{Q) = TrlnQ + y dadb 5{a - b){D^^^ + M«(a))Q(a, b) - 2Hi^{Q) . 

The superscript J in Heff indicates that the effective Hamiltonian depends only on the disorder 
dependent term Hj. Its variation with respect to Q yields: 

:™ = = iQ-^(aM + - ^|gf . (108) 

Multiplying this equation operationally by Q{b, a') (see Appendix A) the dynamic equation takes 
the more familiar Schwinger-Dyson form 

(Di^) + n,{a))Q{a, b) + 6{a-b) + j da' S(a, a')Q{a' , 6) = , (109) 

with 

S(„,„') = -2^^f^. (110) 
oQ[a, a ) 

As mentioned above, we require that Q satisfy the spherical constraint. Thus, we fix the evolution 
of ^s(a) to ensure the validity of this constraint. 

It is now instructive to sec how one recovers the well-known equations for the fully-connected 
model. We have seen in Eq. (103) how the effective Hamiltonian simplifies in this limit. Plugging 
in the Gaussian Ansatz (107), iJ/pj. becomes a simple function of Q{a, b), 



HiFFiQ) = " ^"'('^' ^) ' (111) 

and the self-energy S(a, b) is easily deduced from this expression. A way to prove that the Gaussian 
Ansatz (107) is exact for the fully-connected case is to check that the exact equation for c(^) 
coincides with the one obtained from the Gaussian Ansatz and the saddle-point evaluation. 

In the dilute case, one has to distinguish between the cases p = 2 andp > 3. Indeed, consider the 
expression (96), where one uses the Gaussian Ansatz (107). The integrals over ^' can be formally 
performed with an expansion of the hyperbolic cosine and the use of Wick's theorem. When p = 2, 
all the terms can be written explicitly and the asymptotic behavior of the two-point correlator can 
be worked out. We do not reproduce the calculations here as they do not give more insight into the 
physics of the problem: as expected, at this level of approximation one finds back a behavior typical 
of the fully-connected counterpart model, as was shown in a more direct way in [16]. For p > 3, 
ff/pp can only be cxprcsssed as a series expansion involving the supercorrelators. The properties 
of the Hadamard and operational products explained in the Appendix should allow us to prove 
that the solution to this equation has the same properties as the one for the fully-connected p = 3 
model. 

Even if the ema equations found with the Gaussian Ansatz are much more complicated than the 
one obtained by cutting the series, one can check that it contains the same qualitative information, 
which is the one of the fully connected counterpart model. 
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Soft spin models 

The term vi{^) = a(^'^ — 1)^ in H is not quadratic and one has to resort to an additional 

approximation to treat it. One possibility is to identify the simplest non-trivial term that it 
generates in a series expansion around the critical temperature at which one expects the order 
parameter to vanish, i.e. a second order phase transition. This is the proposal in [44], later used 
in the study of the dynamics of the Shcrrington-Kirkpatrick model in [23]. Another possibility, 
used in [45], is to treat this term in the mode-coupling approximation. The terms obtained with 
the first and the second procedure are slightly different. Even if they modify the details of the 
dynamic solution in the fully-connected case, they do not modify the qualitative features of it. We 
expect these same generic features also in the dilute case. 



3.4.4 Second step: the single defect approximation 

In the study of the density of states of sparse random matrices one can go beyond the Gaussian 
approximation [27, 28]. The same kind of approach can be used in the analysis of the dynamics 
of dilute disorder models. The idea is to use Eqs. (100) and (101) iteratively. In the first step one 
replaces Cema(5') on the right-hand-side of (101) and computes its improved fmictional form. In 
the case of matrices this gives access to the tails in the eigenvalue distribution. We expect that this 
improved approximation will also modify the result for the dynamic behavior considerably since it 
will capture, at least partially, the effect of heterogeneities in the connectivity of the sites in the 
random (hyper) graph. 

In order to clarify the way in which the iteration is implemented, let us neglect the soft-spin 

term (this, of course, is not correct if we are treating an Ising spin problem in which case, as 
already said, we have to treat v with a further approximation). Thus, -ffEFF = -f^EPF ^^"^ order 
to compute the first iteration we insert 



-ap + ap J ••• c(*2) ••• c(*p) cosh ^ J J (ia*i(a) . . . *p(a)^ (112) 



(5c(*i) 

in the right-hand-side of Eq. (100) and expand the last term as 

fe=o ^' 

J D*2 • ..V^p Cema(*2) • • • Cema(*p) cosh J da^i{a) . . . *p(a 



(113) 



For the sake of clarity we concentrate on the p = 2 case. Using now the Gaussian expression for 
Cema(*) with variance Qeua, we find 



Csda(*) = X'Y,^^^^^ e^p ~ J dadb^{a)Ak{a,b)^{b) 



fe=0 

with 



(114) 



Ak{a, b) = -d{a - b)[D^^^ + /x«(a)] - kPQ^^^ia, b) (115) 
Rewriting this equation in the form 

S{a,b) = [D^^^ + Hs{a)]A^'{a,b) - kJ^ J db' QEMA{a,b')A^\b' ,b) (116) 
we realize that this is a Schwinger- Dyson equation for a "system" (the unknown A^I^) in the 

(2) 

presence of a complex external bath: a white bath giving rise to the dynamic operator Da and 
a "colored bath" function of the SUSY self-energy Qema [46, 5]. The latter has a slow relaxation. 
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of glassy type, since in the EMA the dilute model behaves in a very similar manner to its fully- 
connected relative. This means that the SUSY correlator Qema encodes a correlation and a response 
with two two-time regimes, a stationary and an aging one, the former controlled by the temperature 
of the external bath and the latter characterized by an effective temperature that differs from the 
one of the environment. If we assume — a hypothesis that has to checked! that the effect of this 
colored bath on the system is as discussed in [46, 5], the latter will follow the dynamics dictated 
by the complex bath with two time-scales and two values of the effective temperature. 

The spirit of the iteration is to use the previously determined value of Q{a,b) as an input. 
For the spherical model /Us(i) is also a function that is self-consistently determined to impose the 
spherical constraint at equal times. We believe that a convenient way to deal with the constraint 
is to impose it on each step of the approximation. Thus, we let the value of iigit) appearing in the 
SDA level of the calculation free and we fix it by imposing that the correlations at equal times be 
normalized to one. To this end, it is convenient to impose the spherical condition on A^^ since 
this ensures, automatically, the normalization of Qsda at equal times with A' = 1. 

Now, using gsDA(a,6) = / 2?* *(a)4'(6)csDA(^'), we have 



One recognizes in (117) a scries with the same structure as Eq. (29) in [28]. As explained in this 
reference, this series captures the effect of the heterogeneities in the connectivity of sites in the 
random graph. Each term represents the contribution of sites connected to k neighbors. The sda 
super correlator is then a very different entity from the EMA one. It is given by the "superposition" 
of independent aging systems (labeled by k) each weighted with the Poissonian distribution. 

The complete solution of the problem, at this step, needs more work. We should be able to 
estimate the behavior of this two-time dependent series but this is not an easy task. It would be 
very interesting to check how the results in [16] are recovered with this approach. In particular, 
a property of this solution that is not easily seen from the calculations above is the fact that the 
asymptotic value of the Lagrange multiplier actually diverges when p = 2. 

4 Conclusions 

In this paper we discussed several aspects of the dynamics of disordered spin models. 

The first part is general and deals with the generic properties of many-point functions in 
equilibrium and the modifications expected out of equilibrium for models with slow dynamics. In 
particular we formulate an explicit conjecture, cfr. Eq. (77), for the out-of-equilibrium FD relations 
relating the multi-time correlation and response functions. This conjecture proves to be correct 
for gaussian aging processes, and should be amenable for a numerical check. 

In the second part of the paper we presented an approach to the disordered averaged dynamics 
of dilute random spin models. Since with this approach we study the dynamic generating functional 
averaged over disorder we only have access to typical properties and we cannot follow the single spin 
dynamics in the particular background of a quench disorder realization. This should be contrasted 
with the recent advances in static calculations which allows a detailed sample-by-sample analysis 
of similar models [13, 36]. 

When making contact between the generic method we discussed here and the explicit solution 
to the spherical dilute spin-glass model with two-body interactions [16] we see that with each 
level of the approximation we access different time-scales. Indeed, with the first ema we only see 
the dynamics in a first long-times scale that resembles strongly the fully-connected partner of the 
model. With this calculation the fluctuations in the connectivities are averaged out and the result 
is consistent with it. One step beyond one sees the fluctuations in the number of first neighbors 
of the sites and the disordered-average dynamics feels the existence of the special sites with larger 
connectivity than the average one, in a longer (still aging) time-scale. It would be interesting to 
understand how the existence and number of these time-scales and/or the behavior of the system 
in them is modified when including more levels in the iteration. 




(117) 



21 



A Properties of super correlators 



Two products between SUSY correlators can be defined. These are the convolution and the 
Hadamard product: 

Q'^^Ha,b)®Q'^^\b,c) = j dbQ'^^\a,b)Q^^\h,c) , 

g«(o,6).Q(2)(o,fe) = Q^'\a,b)Q^^\a,b) . (118) 

These products are associative and commutative. 

If one multiplies two SUSY correlators of the form (93) with either of these products one obtains 
another SUSY correlator of the same form. Its new "components" are given by functionals of the 
components of the original susy correlators. Indeed, 

Q{a, b) = (Q(i) ® Q^^^Ka, b) = C{ta, U) + (0^ - da) {ObRita, h) - eaR{t2,ti)) (119) 



with 



and 



with 



C{ta,h) = J dto [R^^\ta,U)C^^\t,,h)+C^^\ta,tc)R^^\h,U)\ , 

R{ta,tb) = J dtc R^^\ta,tc)R^^\tc,tb) , (120) 

Q{a, b) = (Q(l) . g('))(a, b) = C{ta, h) + (Sb - 0a) {ObR{ta, tb) - eaR{t2, h)) (121) 



c{t,,tb) = c^'Ht,,tb)c^^\ta,tb) , 

R{ta,tb) = R^'\ta,tb)C^^\ta,tb) + C^'\ta,tb)R^''\ta,tb) . (122) 

It is very simple to check that time-translation invariance and the fluctuation-dissipation re- 
lation are conserved by these products. More precisely, if one multiplies two super correlators 
satisfying these properties, the results will also verify them. Moreover, multiplying two super- 
correlators evaluated in times that are suSiciently far away such that they evolve in their slow 
(aging) scale, the result will also be slow. This property is apparent for the Hadamard product. 
To prove it for the convolution one needs to separate the integration time in several intervals and 
approximate the integrals as usually done when solving the dynamics of fully-connected models 
(sec e.g. [5]). By induction one can then prove that any fc-th power in the Hadamard or convo- 
lution sense of a SUSY correlator in the fast, stationary regime yields a result within this regime. 
Similarly, any Hadamard or convolution power of SUSY correlators in the slow, aging regime stays 
in the same regime. This property is very useful for solving the EMA equations. 
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